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Abstract 

Background: Although activity and participation are the target domains in stroke rehabilitation interventions, there 
is insufficient evidence available regarding the validity of participation measurement. The purpose of this study was 
to investigate the psychometric properties of the London Handicap Scale in community-dwelling stroke patients, 
using Rasch analysis. 

Methods: Participants were 170 community-dwelling stroke survivors. The data were analyzed using Winsteps 
(version 3.62) with the Rasch model to determine the unidimensionality of item fit, the distribution of item difficulty, 
and the reliability and suitability of the rating process for the London Handicap Scale. 

Results: Data of 16 participants did not fit the Rasch model and there were no misfitting items. The person separation 
value was 2.42, and the reliability was .85; furthermore, the rating process for the London Handicap Scale was found to 
be suitable for use with stroke patients. 

Conclusions: This was the first trial to investigate the psychometric properties of the London Handicap Scale using Rasch 
analysis; the results supported the suitability of this scale for use with stroke patients. 
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Background 

Stroke is one of the most common chronic conditions 
observed in aging populations. While stroke mortality 
rates have declined due to developments in medicine 
[1,2], one-third of stroke victims are left with significant 
permanent disability [3,4]. Stroke survivors require re- 
habilitation services and long-term care and support. 
Numerous stroke survivors will never recover their pre- 
stroke level of functioning [5]. 

Disability is not only a health problem but also a com- 
plex phenomenon reflecting the interaction between the 
features of a persons body and the society in which they 
live. Participation in the community enhances the well- 
being of people with disabilities. It can also decrease the 
long-term costs of care and support. Participation measure- 
ment is critical in determining the effects of rehabilitation 
interventions. Participation is the main goal in rehabilita- 
tion, which is largely due to its positive benefits. Given the 
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requirement for participation in rehabilitation, rates of 
participation in people with disabilities are far lower than 
those observed in people without disabilities [6,7]. 

While interventions designed to reduce motor impair- 
ment and disabilities have traditionally been the most 
common focus in stroke rehabilitation, the concept of 
participation has received much interest since the 
World Health Organization s publication of the Inter- 
national Classification of Functioning, Disability, and 
Health (ICF) [8]. The ICF suggests that impairment 
and disability should be viewed in terms of their social 
aspects, and rehabilitation intervention should focus 
on correcting activity limitations and participation re- 
strictions rather than motor impairments [8]. Cur- 
rently, activity and participation are the target domains 
in rehabilitation intervention [9,10]. This paradigm 
shift has increased the demand for measures to assess 
stroke survivors' participation. 

Although participation is a multidimensional con- 
struct, and there is no gold standard for participation 
[11], a valid tool for participation measurement is 
needed. Despite the fact that more than 30 methods of 
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participation measurement can be found in literature 
[12], there is no agreement with respect to which of 
these are appropriate tools. The main reason for dis- 
agreement is the difficulty of operation definition on 
participation and subjective characteristics [13]. Participa- 
tion measurement is required for rehabilitation program 
planning, monitoring and evaluation, assessing the impact 
of interventions [14], and providing a more objective view 
of recovery [15]. 

Participation is one of the areas in which high levels of 
measurement have not been achieved and well-developed 
and conceptually sound instruments are still required [16]. 
Some measurements include items that assess participation 
levels [14], such as the London Handicap Scale (LHS) [17], 
which is widely used for measuring participation, because it 
is quick to administer. The LHS is well known as a means 
of assessing the ICFs concept of participation restrictions 
[13]. The psychometric properties of the LHS, including its 
validity [18], reliability [17], and responsiveness [19], have 
been reported in previous research. 

Although many studies have used the LHS to measure 
participation in stroke patients [20,21], few have specific- 
ally examined the psychometric properties of the LHS in 
this group through item response theory. The uses of 
tools that do not examine these psychometric properties 
are likely to lead to difficulties with respect to the 
reproduction of the results of intervention or research. 

Because measurement tools with good psychometric 
properties are essential in documenting the effects or 
impacts of any clinical intervention [16], searching for a 
valid tool for the measurement of participation, which is 
one of the major outcomes of stroke rehabilitation, is 
essential. Many factors affect a researcher s choice regard- 
ing the most appropriate psychological test to use for a 
specific application. These factors include study sample 
characteristics, practical issues such as respondent burden 
and mode of administration, the original purpose of candi- 
date instruments, and psychometric properties [22]. It is 
important to evaluate the psychometric properties of a test 
systematically within a specific population before the test 
is used for that population, because these properties are 
affected by population characteristics [23] . 

The traditional method for examining psychometric 
properties is based on classical test theory. More re- 
cently, item response theory, which is based on the ap- 
plication of a related mathematical model, has become 
the predominant paradigm and is considered superior 
to classical test theory. Rasch analysis, a specific form 
of item response theory, is employed not only to evalu- 
ate the validity and development of outcome measures 
but also to examine the validity of an instrument 
within a clinical population [24,25]. Rasch analysis is 
less sample-dependent and more broadly useful rela- 
tive to classical test theory, because it provides a more 



comprehensive understanding of the latent structure of 
the test [26]. 

The purpose of this study was to investigate the psy- 
chometric properties of the LHS in community-dwelling 
stroke patients using Rasch analysis in order to deter- 
mine the utility of the LHS for stroke patients. Evidence 
regarding the psychometric properties of the LHS in 
stroke patents will facilitate research into participation 
interventions and provide valid data regarding participa- 
tion in stroke patients. 

Methods 

Participants 

The sample for this cross-sectional study was chosen 
from community- dwelling stroke patients visiting a con- 
valescent center for people with disabilities in South 
Korea. Ethical approval was granted by the ethics review 
board at our affiliated university, and participants were 
assured of confidentiality and their anonymity. The only 
exclusion criterion for the study was cognitive dysfunc- 
tion, as demonstrated by a score of <18 on the Korean 
version of the Mini Mental State Examination (MMSE- 
K). Interviews were carried out by trained registered 
physical therapists. Questionnaire responses and partici- 
pation measurements for 170 participants were analyzed; 
none had missing data. The participants' ages ranged 
from 20 to 87 years, with an average age of 55.34 years 
(SD = 12.23), and 21.8% of the participants were female. 
The stroke diagnosis periods ranged from 3 to 360 months, 
with an average of 51.20 months (SD = 52.60). The mean 
score for the MMSE-K was 23.89 (SD = 2.85). 

Measurement 

The LHS was administered to all participants. The LHS is a 
self-administered, six-item questionnaire that assesses the 
impact of chronic disease in six dimensions: orientation, 
physical independence, mobility, occupation, social inter- 
action, and economic self-efficiency [11]. Each dimension is 
rated from 1 to 6. 

Statistical analysis 

Rasch analysis has been used to aid the construction and 
validation of health status questionnaires for various pa- 
tient groups, including stroke patients [27-29]. Rasch 
analysis is a unidimensional model that assumes that an 
item response is the result of an interaction between the 
scale item response and the respondents ability. Rasch 
analysis is referred to as a "rating scale model" [30] and 
is appropriate for modeling Likert-type response data. In 
this study, the rating scale model was used because the 
LHS consisted of a Likert scale and employed the same 
rating scale for all items. Data were analyzed using the 
Winsteps program (Version 3.62) [31]. 
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Two indices, including the infit mean square statistic 
(infit MNSQ) and the outfit mean square statistic (outfit 
MNSQ) were used to confirm unidimensionality, exam- 
ine whether items contributed adequately to the LHS 
domains, and identify misfitting items. The infit MNSQ 
is a residual and is sensitive to the persons estimated 
abilities, while the outfit MNSQ is sensitive to unex- 
pected outliers for either person or item parameters 
[32]. In this study, if the item or participant infit fell 
between 0.60 and 1.40, it was considered to fit the model 
appropriately [33]. 

Items that are used to describe a construct are ar- 
ranged in hierarchical order of difficulty along a con- 
tinuum. In Rasch analysis, both the persons ability and 
the item difficulty are expressed as logits, which are 
natural logarithms of the odds of a person being able to 
perform a specific task. Logits with a greater positive 
magnitude show increasing item difficulty [27]. The reliabil- 
ity was examined using the person separation reliability 
statistic. The separation index (SI) must exceed 2 to achieve 
the desired level of separation reliability (i.e., a value of 
0.80) and exceed 3 to attain a value of 0.90 [34]. 

Each item was defined by a series of threshold para- 
meters describing the difficulty or probability of the re- 
sponse categories in Rasch analysis. The rating scale 
analysis includes category frequencies, average measures, 
threshold estimates, probability curves, and category fit. 
An items rating scale was considered appropriate if 
the threshold increased by at least 1.4 logits between 
categories [35]. 

Results 

Sixteen participants did not fit the model, because 
their standard infit value exceeded 2.0; therefore, these 
participants were excluded. There were no misfitting 
items (Table 1). Figure 1 shows the distribution of per- 
son measures and item locations plotted along the 
same ability level, in addition to the hierarchical order 
of the six items. 

The person separation was 2.42 and the reliability co- 
efficient was 0.85. The reliability of all six items was at 



an acceptable level for stroke patients. 

Table 1 Item fit statistics: entry order 

Item Measure S.E. 



1. Mobility 51.24 .95 

2. Physical independence 49.22 .93 

3. Occupation 40.46 .90 

4. Social integration 50.53 .94 

5. Orientation 63.20 1.12 

6. Economic self-sufficiency 45.35 .91 
MNSQ: Mean Square; SE: Standard Error. 



The rating scale analysis is summarized in Table 2, 
and the category probability curve is depicted in Figure 2. 
The average modeled LHS measures for all patients 
who chose each response category increased with the 
category values. The threshold increased more than 1.4 
logits between categories. Furthermore, the infit and 
outfit statistics appeared adjacent. Therefore, the rat- 
ing scale, from 1 to 6, was determined to be suitable 
for use with stroke patients. 

Discussion 

The objective of this study was to use Rasch analysis to 
validate the LHS for use with community-dwelling 
stroke patients. We investigated its unidimensionality 
through item fit, the distribution of item difficulty and 
reliability, and the suitability of the rating scale. The 
reliability of the LHS was satisfactory and the rating 
scale was suitable for use with stroke patients. Further- 
more, there were no misfitting items, and the LHS 
showed unidimensionality. 

Item fit is a tool for determining the unidimensionality 
of a psychometric measure, showing how each item fits in a 
single dimension. The fit statistics of the six items sup- 
ported the proposed unidimensionality of the LHS. A high 
MNSQ value for an item indicates that item is not 
homogenous with the other items, whereas a low MNSQ 
value indicates that an item is a duplicate of another [36]. 
The ideal value of MNSQ is 1 [37]. In this study, we chose 
a range of 0.60-1.40 for the infit MNSQ and an outfit 
MNSQ of greater than 1.40 to determine whether the scale 
items fit the model. The economic self-sufficiency item was 
the closest to being a misfit, having an inordinately high 
MNSQ value. The possibility of different dimensions of 
economic self-sufficiency was reported in a previous study 
investigating the validity of the LHS [38]. An exploratory 
factor analysis to confirm the construct validity of the LHS 
presented two factors. One factor includes all items, with 
the exception of economic self-sufficiency. Although the fit 
indices of economic self-sufficiency were acceptable, further 
investigation of this phenomenon is required. 

Various validity values for the LHS in stroke patients 
have been reported in both chronic and acute phases via 
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Figure 1 Person ability/item difficulty map of the six LHS items. 

X: one person; M: mean; S: 1 SD from the mean; T: 2 SD from the mean. 



classical test theory. Harwood et al. [17] reported correl- 
ation coefficients of 0.56 with the Barthel Index, 0.69 
with the Nottingham Extended Activities for Daily Liv- 
ing Scale total scores, -0.42 with Nottingham Health 
Profile total scores, and -0.42 with the Geriatric Depres- 
sion Scale in chronic stroke patients. Hershkovitz et al. 
[39] provided evidence of the validity of the LHS in acute 
stroke patients with correlation coefficients of -0.52 with 
the FIM, -0.46 with the Nottingham Prognostic Index, 
and 0.35 with the Timed Get Up and Go test. Reasonable 



Table 2 Summary of the rating scale analysis 


Category 


Observed 


milt 


UUtTIt 


Structure 


label 


average 


MNSQ 


MNSQ 


calibration 


1 


-23.71 


1.10 


41.06 


None 


2 


-14.67 


1.01 


.99 


-21.95 


3 


-5.31 


0.98 


.94 


-9.63 


4 


.54 


1.10 


1.06 


3.82 


5 


9.94 


0.81 


.80 


7.69 


6 


16.12 


.93 


.94 


20.07 



face validity was also reported [18]. The validity found in 
previous studies based on classical test theory, and the 
construct validity found via item response theory in this 
study provides evidence for the psychometric properties 
of the LHS. 

Person separation in the Rasch model is equivalent to 
Cronbachs a [31]. In this study, the person separation 
value indicates how well the measure differentiates 
participants on the basis of their participation [27]. The 
minimum recommended acceptable level of person sep- 
aration is .80 [40]. The present study showed a person 
separation value of .85. This value was consistent with 
Westergren and Hagells (2006) study [41] reporting a 
Cronbachs a of .85, which was higher than that of .80 
found by Chau (2009) [42]. Jenkinson et al. [10] reported 
internal consistency of 0.83 in acute stroke patients. 
Test-retest reliability has been found in previous studies; 
for example, Harwood et al. [17] reported a value of 0.91 
in 89 chronic stroke patients. 

Item difficulty was analyzed by comparing person abil- 
ity and item difficulty. When person ability is consistent 
with item difficulty— that is, the distribution ranges of 
the individual attribute and item difficulty are similar— this 
indicates that the item difficulty is adequate [36]. Approxi- 
mately 40% of participants exhibited ability scores that were 
markedly lower than those of the related item difficulty. 
This indicates that the item difficulty of the LHS was 
slightly high for stroke patients. The easiest item was occu- 
pation, while the most difficult was orientation. The LHS 
rating scale was suitable for use with stroke patients. In 
other words, the category measures for all items increased 
in the same direction. 

The LHS provides an overall handicap severity score, 
which can be calculated with traditional weighted scor- 
ing or simple unweighted scoring. Overall handicap 
severity scores range from 0 to 1. Scale values of 1 and 0 
indicate normal function and total disability, respect- 
ively. Each item has a weighted value; for example, the 
value of no mobility disadvantage is 0.071. The overall 
handicap severity score is calculated by summing all six 
utility values plus 0.456 [43]. The simple unweighted 
scoring system, which was suggested by Jenkinson et al. 
[10], rates disability from 0 (extreme disability) to 5 (no 
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disability) for each of the six items, sums the scores, and 
multiplies the total by (100/30). Simple summation scor- 
ing was recommended for the LHS, because it is easier 
to calculate and interpret [10]. In addition, the un- 
weighted scoring system has shown similar results as 
those observed with traditional weighted scoring [10] in 
stroke patients. 

This study had some limitations. Because community- 
dwelling stroke patients visiting a convalescent center 
for people with disabilities in South Korea participated 
in this study, the results were only applicable to these 
participants. Further studies should be conducted to in- 
vestigate unidimensionality. The wide age range could 
have been strength or a weakness. Previous studies have 
involved older patients than those included in this study. 
In two such studies, Hershovitz et al. [39] reported mean 
ages of 71 and 69 years for men and women, respect- 
ively, and Jenkinson et al. [10] reported a mean age of 74 
for their entire sample. As a result of the wide age range 
of 20-87 years, the results of this study could be applic- 
able to a wide range of patients; however, future studies 
should confirm whether the psychometric properties 
differ according to age range. Another limitation was 
that the participants in this study were chronic stroke 
patients. The unidimensionality of the LHS should be ex- 
amined in acute stroke patients to allow for comprehensive 
and effective use of the scale. The responsiveness of 



measurement is a major focus in rehabilitation clinics 
and research. LHS scores at discharge had changed sig- 
nificantly with respect to mobility, physical independ- 
ence, and occupation in study that assessed the effects 
of a day rehabilitation program on handicap in stroke 
patents [39]. Harwood and Ebrahim [44] reported that 
the LHS was reasonably responsive in hip replacement 
patients. In acute stroke patients, the LHS has been 
found to be more sensitive than the Barthel Index in 
measuring outpatient outcomes [44]. The psychomet- 
ric properties of the LHS should be examined in acute 
stroke patients to determine the usefulness of the scale 
in measuring the effects of rehabilitation programs. 

Further research into the dimensionality of participa- 
tion is recommended to advance current knowledge 
regarding the most suitable means of measuring this 
construct. Item response theory enables researchers to 
confirm the assumption of a hierarchy of item diffi- 
culty, which is difficult to achieve using objective par- 
ticipation measures [12] and measurement dimensions. 
The validation of the participation measure in stroke 
survivors forms the basis of activity participation as a 
primary rehabilitation outcome in this population. 
This was the first study to investigate the psychometric 
properties of the LHS using Rasch analysis. The results 
of this study support the utility of the LHS for stroke 
patients. 
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Conclusions 

The purpose of this study was to examine the psychometric 
properties the LHS in community-dwelling stroke patients. 
All of the LHS items fit the Rasch model. This study 
demonstrated good reliability and validity for the LHS with 
respect to measuring participation in community-dwelling 
stroke patients. These findings confirmed the utility of LHS 
outcome measures in stroke patients. 
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